Visual Interface to Speech-Cue Representation Coding
نویسندگان
چکیده
منابع مشابه
Audio-Visual Speech Cue Combination
BACKGROUND Different sources of sensory information can interact, often shaping what we think we have seen or heard. This can enhance the precision of perceptual decisions relative to those made on the basis of a single source of information. From a computational perspective, there are multiple reasons why this might happen, and each predicts a different degree of enhanced precision. Relatively...
متن کاملLearning to use an artificial visual cue in speech identification.
Visual information from a speaker's face profoundly influences auditory perception of speech. However, relatively little is known about the extent to which visual influences may depend on experience, and extent to which new sources of visual speech information can be incorporated in speech perception. In the current study, participants were trained on completely novel visual cues for phonetic c...
متن کاملSpeech/Gesture Interface to a Visual-Computing Environment
Although recent years have witnessed tremendous progress in 3D immersive display and virtual reality, the corresponding humancomputer interaction (HCI) technologies have lagged behind. Current interfaces involve heavy headsets, datagloves, tethers, and other virtual reality devices, which may deter or distract the user. To fully exploit VR’s potential for visualizing and interacting with comple...
متن کاملPatch-Based Representation of Visual Speech
Visual information from a speaker’s mouth region is known to improve automatic speech recognition robustness, especially in the presence of acoustic noise. To date, the vast majority of work in this field has viewed these visual features in a holistic manner, which may not take into account the various changes that occur within articulation (process of changing the shape of the vocal tract usin...
متن کاملA Novel Visual Speech Representation and HMM Classification for Visual Speech Recognition
This paper presents the development of a novel visual speech recognition (VSR) system based on a new representation that extends the standard viseme concept (that is referred in this paper to as Visual Speech Unit (VSU)) and Hidden Markov Models (HMM). The visemes have been regarded as the smallest visual speech elements in the visual domain and they have been widely applied to model the visual...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in Image and Video Processing
سال: 2016
ISSN: 2054-7412
DOI: 10.14738/aivp.42.2010